Skip to content

EXOnanoAODv1 producers and setup#48502

Open
kerstinlovisa wants to merge 9 commits intocms-sw:masterfrom
kerstinlovisa:EXOnanoAODv1
Open

EXOnanoAODv1 producers and setup#48502
kerstinlovisa wants to merge 9 commits intocms-sw:masterfrom
kerstinlovisa:EXOnanoAODv1

Conversation

@kerstinlovisa
Copy link
Copy Markdown

@kerstinlovisa kerstinlovisa commented Jul 8, 2025

PR description:

This PR includes producers and setup for a first version of EXO PAG customizations of nanoAOD, with customization combined from multiple analysis teams working with long-lived particles, including:

  • Displaced muons
  • Displaced electrons
  • Displaced jets (with leptons)
  • Muon detector showers
  • Displaced taus

Previously discussed at the nanoAOD deep dive, within XPOG April 2 2025 and July 9 2025, and within EXO at the EXO workshop and general meeting.

The PR depends on cms-data/RecoTauTag-TrainingFiles#15 PR with training data for the displaced tau tag.

PR validation:

Collections with number of variables and sizes for different datasets has been evaluated:
exonanoaodv1_size_table

Timing study done for running AOD -> EXOnanoAODv1 in one step tested on one file from TTto4Q MC dataset, accounting for differences on different machines. The study shows the relative time difference between producing standard nanoAOD and EXOnanoAODv1 as a function of number of events, with less than a factor 2 relative time increase.
Screenshot 2025-07-09 at 09 21 29

The test script PhysicsTools/NanoAOD/test/test-exoNano.sh runs CMS driver command for AOD->EXOnanoAODv1 in one step (with --step PAT,NANO:(at)EXO) and works for this setup.

@enibigir @jniedzie

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Jul 8, 2025

cms-bot internal usage

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Jul 8, 2025

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48502/45439

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Jul 9, 2025

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48502/45445

Code check has found code style and quality issues which could be resolved by applying following patch(s)

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Jul 9, 2025

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48502/45446

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Jul 9, 2025

Pull request #48502 was updated.

@ftorrresd
Copy link
Copy Markdown
Contributor

enable nano

@ftorrresd
Copy link
Copy Markdown
Contributor

please test

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Jul 9, 2025

-1

Failed Tests: Build ClangBuild
Size: This PR adds an extra 80KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f12b81/47149/summary.html
COMMIT: 7a9ef1f
CMSSW: CMSSW_15_1_X_2025-07-09-1100/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/48502/47149/install.sh to create a dev area with all the needed externals and cmssw changes.

Build

I found compilation warning when building: See details on the summary page.

Clang Build

I found compilation warning while trying to compile with clang. Command used:

USER_CUDA_FLAGS='--expt-relaxed-constexpr' USER_CXXFLAGS='-Wno-register -fsyntax-only' /usr/bin/time -v scram build -k -j 32 COMPILER='llvm compile'

See details on the summary page.

Copy link
Copy Markdown

@battibass battibass left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Here is another round of comments that can be addressed rather easily

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"segmentLabel" I would suggest: "dtSegmentLabel" (as also CSC segments exist, better saying explicitly these are DT ones)

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not return -1? iJet is never updated

Comment on lines 267 to 271
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would pass all of these by reference. Why do you need to use pointers?

Comment on lines 307 to 314
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is equivalent to:

if (daughter.charge() == 0 || daughter.fromPV() < 2 || reco::deltaR(daughter, *cand) > 0.4 || !daughter.hasTrackDetails()) { continue; }

Comment on lines 318 to 329
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The same reasoning applies here.

Comment on lines 184 to 189
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if (el.gsfTrack().isNull() || el.pt() < 7 || fabs(el.eta()) > 2.5){ continue; }

Comment on lines 287 to 296
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As above, please combine in a single if.

Comment on lines 220 to 224
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why passing pointers? Can't you simply use references?

Comment on lines 260 to 267
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

if (daughter.charge() == 0 || daughter.fromPV() < 2 || reco::deltaR(daughter, *cand) > 0.4 !daughter.hasTrackDetails()) { continue; }

Comment on lines 271 to 282
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same comment as just above

@cmsbuild
Copy link
Copy Markdown
Contributor

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f12b81/51907/summary.html
COMMIT: 9953a84
CMSSW: CMSSW_16_1_X_2026-03-11-1100/el8_amd64_gcc13
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/48502/51907/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f12b81/51907/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f12b81/51907/git-merge-result

Comparison Summary

Summary:

  • You potentially added 16 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 53
  • DQMHistoTests: Total histograms compared: 4181048
  • DQMHistoTests: Total failures: 355
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4180673
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 27195.928 KiB( 52 files compared)
  • DQMHistoSizes: changed ( 18434.0,... ): 6798.982 KiB HLT/JME
  • Checked 227 log files, 198 edm output root files, 53 DQM output files
  • TriggerResults: no differences found

Nano size comparison Summary:

  • Nano ERROR: Missing ref/2500.321_EXONANOmc150X-size.json
  • Nano ERROR: Missing ref/2500.321_EXONANOmc150X-size.json
  • Nano ERROR: Missing ref/2500.3311_EXONANOdata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3311_EXONANOdata150Xrun3-size.json
workflow id kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
NANOmc106Xul16v2 2500.0001 3.085 3.085 0.000 ( +0.0% ) 3.72 3.79 -1.7% 2.550 2.544
NANOmc106Xul16APVv2 2500.0002 3.041 3.041 0.000 ( +0.0% ) 3.66 3.78 -3.2% 2.588 2.606
NANOmc106Xul17v2 2500.0003 3.144 3.144 0.000 ( +0.0% ) 3.44 3.51 -1.9% 2.981 3.000
NANOmc106Xul18v2 2500.0004 3.098 3.098 0.000 ( +0.0% ) 3.47 3.57 -2.8% 2.974 2.988
NANOdata106Xul16v2 2500.0101 1.540 1.540 0.000 ( +0.0% ) 6.26 6.32 -0.8% 2.680 2.671
NANOdata106Xul17v2 2500.0102 1.926 1.926 0.000 ( +0.0% ) 4.10 4.19 -2.1% 2.823 2.812
NANOdata106Xul18v2 2500.0103 1.890 1.890 0.000 ( +0.0% ) 4.96 5.02 -1.2% 2.757 2.751
NANOmcUL16APVreMINI 2500.0201 0.022 0.022 0.000 ( +0.0% ) 1.76 1.88 -6.6% 2.581 2.539
NANOmcUL16reMINI 2500.0202 0.022 0.022 0.000 ( +0.0% ) 1.75 1.82 -4.2% 2.576 2.547
NANOmcUL17reMINI 2500.0203 0.022 0.022 0.000 ( +0.0% ) 1.65 1.68 -1.8% 2.704 2.686
NANOmcUL18reMINI 2500.0204 0.022 0.022 0.000 ( +0.0% ) 1.53 1.61 -5.1% 2.727 2.705
NANOdataUL16APVreMINI 2500.0301 0.035 0.035 0.000 ( +0.0% ) 1.52 1.62 -5.9% 2.617 2.596
NANOdataUL16reMINI 2500.0302 0.036 0.036 0.000 ( +0.0% ) 1.47 1.59 -7.6% 2.553 2.527
NANOdataUL17reMINI 2500.0303 0.037 0.037 0.000 ( +0.0% ) 1.44 1.55 -6.6% 2.672 2.631
NANOdataUL18reMINI 2500.0304 0.036 0.036 0.000 ( +0.0% ) 1.45 1.55 -6.5% 2.662 2.617
NANOmcUL16APVMini2Mini 2500.0401 0.023 0.023 0.000 ( +0.0% ) 2.38 2.52 -5.5% 2.178 2.118
NANOmcUL16Mini2Mini 2500.0402 0.023 0.023 0.000 ( +0.0% ) 2.44 2.55 -4.3% 2.183 2.131
NANOmcUL17Mini2Mini 2500.0403 0.023 0.023 0.000 ( +0.0% ) 2.26 2.35 -3.8% 2.160 2.138
NANOmcUL18Mini2Mini 2500.0404 0.023 0.023 0.000 ( +0.0% ) 2.25 2.44 -7.6% 2.166 2.136
NANOdataUL16Mini2Mini 2500.0501 0.039 0.039 0.000 ( +0.1% ) 3.29 3.53 -6.9% 2.037 2.011
NANOdataUL17Mini2Mini 2500.0502 0.040 0.040 0.000 ( +0.0% ) 2.49 2.65 -6.2% 2.097 2.072
NANOdataUL18Mini2Mini 2500.0503 0.039 0.039 0.000 ( +0.0% ) 2.91 3.10 -6.1% 2.111 2.067
NANOmc130X 2500.1001 3.220 3.220 0.000 ( +0.0% ) 4.22 4.25 -0.6% 2.954 2.928
NANOdata130Xrun3 2500.1101 1.790 1.790 0.000 ( +0.0% ) 6.45 6.47 -0.3% 2.639 2.648
NANOmc23Mini2Mini 2500.1201 0.022 0.022 0.000 ( +0.0% ) 2.76 2.79 -0.7% 2.047 2.015
NANOdata23Mini2Mini 2500.1301 0.041 0.041 0.000 ( +0.0% ) 3.56 3.58 -0.6% 2.338 2.308
ScoutingNANOdata124Xrun3 2500.1501 0.772 0.772 0.000 ( +0.0% ) 34.00 34.46 -1.4% 1.476 1.466
ScoutingNANOmonitordata124Xrun3 2500.1502 0.862 0.862 0.000 ( +0.0% ) 14.31 14.53 -1.5% 1.382 1.394
ScoutingNANOdata130Xrun3 2500.1503 1.251 1.251 0.000 ( +0.0% ) 25.07 25.30 -0.9% 1.459 1.434
ScoutingNANOmonitordata130Xrun3 2500.1504 1.297 1.297 0.000 ( +0.0% ) 10.76 11.10 -3.1% 1.373 1.371
muPOGNANOmc140X 2500.2201 2.065 2.065 0.000 ( +0.0% ) 5.59 5.79 -3.4% 2.018 2.015
EGMNANOmc140X 2500.2202 3.849 3.849 0.000 ( +0.0% ) 3.99 4.05 -1.3% 2.347 2.350
BTVNANOmc140X 2500.2203 10.466 10.466 0.000 ( +0.0% ) 2.56 2.61 -1.6% 2.516 2.529
jmeNANOmc140X 2500.2204 6.629 6.629 0.000 ( +0.0% ) 1.16 1.15 +0.6% 2.433 2.434
lepTrackInfoNANOmc140X 2500.2206 3.543 3.543 0.000 ( +0.0% ) 4.06 4.06 +0.1% 2.374 2.349
ScoutingNANOmc140X 2500.2207 1.488 1.488 0.000 ( +0.0% ) 14.30 14.58 -2.0% 1.793 1.789
ScoutingNANOwithPromptmc140X 2500.2208 4.452 4.452 0.000 ( +0.0% ) 2.99 3.24 -7.9% 2.720 2.705
muPOGNANO140Xrun3 2500.2301 1.469 1.469 0.000 ( +0.0% ) 8.10 8.06 +0.6% 2.299 2.281
EGMNANOdata140Xrun3 2500.2302 2.623 2.623 0.000 ( +0.0% ) 5.86 5.70 +2.9% 2.578 2.603
BTVNANOdata140Xrun3 2500.2303 5.612 5.612 0.000 ( +0.0% ) 3.73 3.76 -0.9% 2.763 2.788
jmeNANOdata140Xrun3 2500.2304 3.976 3.976 0.000 ( +0.0% ) 1.48 1.49 -0.5% 2.684 2.664
lepTrackInfoNANOdata140Xrun3 2500.2306 2.413 2.413 0.000 ( +0.0% ) 5.85 5.88 -0.5% 2.631 2.605
ScoutingNANOdata140Xrun3 2500.2307 1.101 1.101 0.000 ( +0.0% ) 30.16 30.37 -0.7% 1.473 1.443
ScoutingNANOmonitordata140Xrun3 2500.2308 2.784 2.784 0.000 ( +0.0% ) 4.71 5.14 -8.3% 2.957 2.829
ScoutingNANOmonitorWithPromptdata140Xrun3 2500.2309 2.784 2.784 0.000 ( +0.0% ) 4.68 5.12 -8.7% 2.926 2.807
L1ScoutingSelectionNANOdata140Xrun3 2500.2311 0.081 0.081 0.000 ( +0.0% ) 46.31 46.25 +0.1% 0.692 0.670
L1ScoutingNANOdata140Xrun3 2500.231 0.082 0.082 0.000 ( +0.0% ) 3.99 4.01 -0.4% 0.839 0.818
l1DPGNANO140Xrun3 2500.2401 9.405 9.405 0.000 ( +0.0% ) 6.46 7.18 -10.0% 1.743 1.720
muDPGNANO140Xrun3 2500.2402 10.377 10.377 0.000 ( +0.0% ) 1.66 1.68 -1.0% 1.619 1.596
muDPGNANOBkg140Xrun3 2500.2403 6.401 6.401 0.000 ( +0.0% ) 15.27 16.20 -5.7% 1.176 1.161
hcalDPGNANO140Xrun3 2500.2404 486.015 486.015 0.000 ( +0.0% ) 1.16 1.17 -1.2% 1.575 1.572
hcalDPGCalibNANO140Xrun3 2500.2405 826.418 826.418 0.000 ( +0.0% ) 1.50 1.52 -1.7% 1.597 1.562
hcalDPGMCNANO140Xrun3 2500.2501 645.333 645.333 0.000 ( +0.0% ) 1.67 1.66 +0.5% 1.673 1.655
NANOmc2024reMINI 2500.2601 0.021 0.021 0.000 ( +0.0% ) 1.91 1.95 -2.0% 2.620 2.597
NANOdata2024reMINI 2500.2701 0.036 0.036 0.000 ( +0.0% ) 1.89 1.92 -1.5% 2.581 2.550
NANOmc150X 2500.3001 3.217 3.217 0.000 ( +0.0% ) 16.72 17.99 -7.0% 2.558 2.489
NANOdata150X 2500.3101 2.144 2.144 0.000 ( +0.0% ) 33.08 35.23 -6.1% 2.238 2.214
NANOdata150X 2500.3102 2.630 2.630 0.000 ( +0.0% ) 28.47 28.96 -1.7% 2.250 2.224
muPOGNANOmc150X 2500.3201 2.255 2.255 0.000 ( +0.0% ) 15.79 16.74 -5.7% 2.361 2.337
EGMNANOmc150X 2500.3202 4.110 4.110 0.000 ( +0.0% ) 14.65 14.83 -1.2% 2.469 2.455
BTVNANOmc150X 2500.3203 10.552 10.552 0.000 ( +0.0% ) 4.59 4.94 -7.2% 2.671 2.055
jmeNANOmc150X 2500.3204 6.452 6.452 0.000 ( +0.0% ) 1.12 1.37 -18.6% 2.074 2.030
jmeNANOrePuppimc150X 2500.3205 6.456 6.456 0.000 ( +0.0% ) 1.08 1.28 -15.9% 2.383 2.272
lepTrackInfoNANOmc150X 2500.3206 3.720 3.720 0.000 ( +0.0% ) 12.80 15.38 -16.7% 2.462 2.435
ScoutingNANOmc150X 2500.3207 1.563 1.563 0.000 ( +0.0% ) 17.72 20.06 -11.7% 2.219 1.686
ScoutingNANOwithPromptmc150X 2500.3208 4.774 4.774 0.000 ( +0.0% ) 10.67 10.63 +0.3% 2.770 2.686
BPHNANOmc150X 2500.3209 4.126 4.126 0.000 ( +0.0% ) 17.29 17.36 -0.4% 2.596 2.512
muPOGNANO150Xrun3 2500.3301 1.125 1.125 0.000 ( +0.0% ) 28.43 32.55 -12.7% 2.061 1.742
EGMNANOdata150Xrun3 2500.3302 2.985 2.985 0.000 ( +0.0% ) 23.98 26.79 -10.5% 2.176 1.819
BTVNANOdata150Xrun3 2500.3303 7.971 7.971 0.000 ( +0.0% ) 5.25 6.01 -12.6% 2.355 2.330
jmeNANOdata150Xrun3 2500.3304 4.349 4.349 0.000 ( +0.0% ) 1.34 1.69 -20.5% 2.038 1.998
jmeNANOrePuppidata150Xrun3 2500.3305 4.332 4.332 0.000 ( +0.0% ) 1.25 1.46 -14.8% 2.289 2.251
lepTrackInfoNANOdata150Xrun3 2500.3306 2.625 2.625 0.000 ( +0.0% ) 25.12 28.78 -12.7% 2.202 2.130
ScoutingNANOdata150Xrun3 2500.3307 1.738 1.738 0.000 ( +0.0% ) 26.19 32.45 -19.3% 1.477 1.268
ScoutingNANOmonitordata150Xrun3 2500.3308 1.400 1.400 0.000 ( +0.0% ) 19.75 27.91 -29.2% 2.103 1.939
ScoutingNANOmonitorWithPromptdata150Xrun3 2500.3309 2.602 2.602 0.000 ( +0.0% ) 14.66 18.33 -20.0% 2.456 2.045
BPHNANOdata150Xrun3 2500.331 2.632 2.632 0.000 ( +0.0% ) 24.73 34.18 -27.7% 2.267 1.995
TTbarMINIAOD10.6_UL18v2 2500.9001 1.819 1.819 0.000 ( +0.0% ) 29.47 36.62 -19.5% 1.781 1.744
TTbarMINIAOD14.0 2500.9002 1.665 1.665 0.000 ( +0.0% ) 24.89 33.60 -25.9% 1.360 1.362
DYToLL_M-50_13TeV_pythia8 2500.9101 15.163 15.163 0.000 ( +0.0% ) 6.61 7.48 -11.6% 1.046 1.024
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV 2500.9102 0.437 0.310 0.126 ( +40.7% ) 3.18 2.24 +41.9% 0.836 0.811
TTbar_Pow_LHE_13TeV 2500.9103 0.110 0.110 0.000 ( +0.0% ) 1.95 2.47 -21.0% 0.835 0.821

NANO Comparison Summary

Summary:

  • You potentially removed 889 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 32
  • DQMHistoTests: Total histograms compared: 43020
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 43020
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
  • Checked 181 log files, 106 edm output root files, 32 DQM output files
  • TriggerResults: no differences found

@cmsbuild
Copy link
Copy Markdown
Contributor

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48502/48490

Code check has found code style and quality issues which could be resolved by applying following patch(s)

@cmsbuild
Copy link
Copy Markdown
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48502/48491

@cmsbuild
Copy link
Copy Markdown
Contributor

Pull request #48502 was updated. @AdrianoDee, @DickyChant, @antoniovagnerini, @battibass, @cmsbuild, @ftorrresd, @miquork can you please check and sign again.

@kerstinlovisa
Copy link
Copy Markdown
Author

Here is another round of comments that can be addressed rather easily

Thanks for the comments @battibass; all of them should have been addressed now.

@tvami
Copy link
Copy Markdown
Contributor

tvami commented Mar 13, 2026

@cmsbuild please test

@jalimena
Copy link
Copy Markdown
Contributor

again... you have to test this PR with cms-data/RecoTauTag-TrainingFiles#16 or the tests will fail, see above

@tvami
Copy link
Copy Markdown
Contributor

tvami commented Mar 13, 2026

@jalimena #48502 (comment) already set the test parameters

@jalimena
Copy link
Copy Markdown
Contributor

ah ok cool my bad @tvami

@cmsbuild
Copy link
Copy Markdown
Contributor

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f12b81/51949/summary.html
COMMIT: 8263cc1
CMSSW: CMSSW_16_1_X_2026-03-13-1100/el8_amd64_gcc13
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/48502/51949/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f12b81/51949/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f12b81/51949/git-merge-result

Comparison Summary

There are some workflows for which there are errors in the baseline:
1000.0 step 2
312.0 step 3
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

Summary:

  • You potentially added 374 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 24353 differences found in the comparisons
  • DQMHistoTests: Total files compared: 51
  • DQMHistoTests: Total histograms compared: 4009598
  • DQMHistoTests: Total failures: 43590
  • DQMHistoTests: Total nulls: 12
  • DQMHistoTests: Total successes: 3965978
  • DQMHistoTests: Total skipped: 18
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.012 KiB( 50 files compared)
  • DQMHistoSizes: changed ( 2024.0040001 ): 0.012 KiB JetMET/SUSYDQM
  • Checked 223 log files, 194 edm output root files, 51 DQM output files
  • TriggerResults: found differences in 4 / 49 workflows

Nano size comparison Summary:

  • Nano ERROR: Missing ref/2500.321_EXONANOmc150X-size.json
  • Nano ERROR: Missing ref/2500.321_EXONANOmc150X-size.json
  • Nano ERROR: Missing ref/2500.3311_EXONANOdata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3311_EXONANOdata150Xrun3-size.json
workflow id kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
NANOmc106Xul16v2 2500.0001 3.085 3.085 0.000 ( +0.0% ) 3.73 3.67 +1.6% 2.587 2.577
NANOmc106Xul16APVv2 2500.0002 3.041 3.041 0.000 ( +0.0% ) 3.72 3.64 +2.2% 2.630 2.636
NANOmc106Xul17v2 2500.0003 3.144 3.144 0.000 ( +0.0% ) 3.45 3.40 +1.4% 3.040 3.031
NANOmc106Xul18v2 2500.0004 3.098 3.098 0.000 ( +0.0% ) 3.52 3.48 +1.2% 3.023 3.023
NANOdata106Xul16v2 2500.0101 1.540 1.540 0.000 ( +0.0% ) 6.25 6.14 +1.9% 2.698 2.718
NANOdata106Xul17v2 2500.0102 1.926 1.926 0.000 ( +0.0% ) 4.13 4.08 +1.3% 2.822 2.899
NANOdata106Xul18v2 2500.0103 1.890 1.890 0.000 ( +0.0% ) 5.01 4.88 +2.7% 2.778 2.767
NANOmcUL16APVreMINI 2500.0201 0.022 0.022 0.000 ( +0.0% ) 1.73 1.75 -1.0% 2.547 2.582
NANOmcUL16reMINI 2500.0202 0.022 0.022 0.000 ( +0.0% ) 1.73 1.77 -2.2% 2.652 2.594
NANOmcUL17reMINI 2500.0203 0.022 0.022 0.000 ( +0.0% ) 1.66 1.62 +2.1% 2.686 2.735
NANOmcUL18reMINI 2500.0204 0.022 0.022 0.000 ( +0.0% ) 1.55 1.58 -2.3% 2.720 2.709
NANOdataUL16APVreMINI 2500.0301 0.035 0.035 0.000 ( +0.0% ) 1.52 1.57 -3.3% 2.632 2.619
NANOdataUL16reMINI 2500.0302 0.036 0.036 0.000 ( +0.0% ) 1.43 1.59 -10.1% 2.563 2.549
NANOdataUL17reMINI 2500.0303 0.037 0.037 0.000 ( +0.0% ) 1.48 1.51 -2.0% 2.669 2.637
NANOdataUL18reMINI 2500.0304 0.036 0.036 0.000 ( +0.0% ) 1.45 1.53 -4.8% 2.641 2.633
NANOmcUL16APVMini2Mini 2500.0401 0.023 0.023 0.000 ( +0.0% ) 2.35 2.32 +1.3% 2.178 2.171
NANOmcUL16Mini2Mini 2500.0402 0.023 0.023 0.000 ( +0.0% ) 2.48 2.43 +2.4% 2.175 2.135
NANOmcUL17Mini2Mini 2500.0403 0.023 0.023 0.000 ( +0.0% ) 2.14 2.30 -6.8% 2.177 2.168
NANOmcUL18Mini2Mini 2500.0404 0.023 0.023 0.000 ( +0.0% ) 2.32 2.36 -1.8% 2.150 2.169
NANOdataUL16Mini2Mini 2500.0501 0.039 0.039 0.000 ( +0.0% ) 3.28 3.56 -7.9% 2.020 2.021
NANOdataUL17Mini2Mini 2500.0502 0.040 0.040 0.000 ( +0.0% ) 2.46 2.50 -1.4% 2.091 2.075
NANOdataUL18Mini2Mini 2500.0503 0.039 0.039 0.000 ( +0.0% ) 2.92 3.01 -3.0% 2.088 2.078
NANOmc130X 2500.1001 3.220 3.220 0.000 ( +0.0% ) 4.23 4.10 +3.2% 3.048 2.927
NANOdata130Xrun3 2500.1101 1.790 1.790 0.000 ( +0.0% ) 6.48 6.33 +2.5% 2.653 2.647
NANOmc23Mini2Mini 2500.1201 0.022 0.022 0.000 ( +0.0% ) 2.79 2.71 +3.0% 2.029 2.024
NANOdata23Mini2Mini 2500.1301 0.041 0.041 0.000 ( +0.0% ) 3.57 3.48 +2.7% 2.314 2.343
ScoutingNANOdata124Xrun3 2500.1501 0.772 0.772 0.000 ( +0.0% ) 34.38 33.52 +2.6% 1.477 1.487
ScoutingNANOmonitordata124Xrun3 2500.1502 0.862 0.862 0.000 ( +0.0% ) 14.30 14.06 +1.7% 1.398 1.396
ScoutingNANOdata130Xrun3 2500.1503 1.251 1.251 0.000 ( +0.0% ) 25.38 24.70 +2.7% 1.465 1.446
ScoutingNANOmonitordata130Xrun3 2500.1504 1.297 1.297 0.000 ( +0.0% ) 10.89 10.88 +0.1% 1.396 1.391
muPOGNANOmc140X 2500.2201 2.065 2.065 0.000 ( +0.0% ) 5.79 5.62 +3.1% 2.031 2.023
EGMNANOmc140X 2500.2202 3.849 3.849 0.000 ( +0.0% ) 4.06 3.98 +2.0% 2.369 2.352
BTVNANOmc140X 2500.2203 10.466 10.466 0.000 ( +0.0% ) 2.59 2.53 +2.3% 2.547 2.536
jmeNANOmc140X 2500.2204 6.629 6.629 0.000 ( +0.0% ) 1.16 1.12 +3.2% 2.449 2.447
lepTrackInfoNANOmc140X 2500.2206 3.543 3.543 0.000 ( +0.0% ) 4.08 3.99 +2.2% 2.359 2.357
ScoutingNANOmc140X 2500.2207 1.488 1.488 0.000 ( +0.0% ) 14.03 13.93 +0.7% 1.795 1.785
ScoutingNANOwithPromptmc140X 2500.2208 4.452 4.452 0.000 ( +0.0% ) 2.99 3.13 -4.4% 2.727 2.732
muPOGNANO140Xrun3 2500.2301 1.469 1.469 0.000 ( +0.0% ) 8.08 7.91 +2.1% 2.288 2.282
EGMNANOdata140Xrun3 2500.2302 2.623 2.623 0.000 ( +0.0% ) 5.84 5.68 +2.9% 2.612 2.607
BTVNANOdata140Xrun3 2500.2303 5.612 5.612 0.000 ( +0.0% ) 3.73 3.64 +2.5% 2.790 2.792
jmeNANOdata140Xrun3 2500.2304 3.976 3.976 0.000 ( +0.0% ) 1.49 1.45 +2.8% 2.676 2.665
lepTrackInfoNANOdata140Xrun3 2500.2306 2.413 2.413 0.000 ( +0.0% ) 5.86 5.65 +3.8% 2.615 2.618
ScoutingNANOdata140Xrun3 2500.2307 1.101 1.101 0.000 ( +0.0% ) 30.20 29.79 +1.4% 1.469 1.452
ScoutingNANOmonitordata140Xrun3 2500.2308 2.784 2.784 0.000 ( +0.0% ) 4.64 4.96 -6.5% 2.948 2.935
ScoutingNANOmonitorWithPromptdata140Xrun3 2500.2309 2.784 2.784 0.000 ( +0.0% ) 4.68 4.97 -5.7% 2.942 2.942
L1ScoutingSelectionNANOdata140Xrun3 2500.2311 0.081 0.081 0.000 ( +0.0% ) 46.48 45.67 +1.8% 0.682 0.716
L1ScoutingNANOdata140Xrun3 2500.231 0.082 0.082 0.000 ( +0.0% ) 4.00 3.96 +1.0% 0.827 0.819
l1DPGNANO140Xrun3 2500.2401 9.405 9.405 0.000 ( +0.0% ) 7.25 7.31 -0.8% 1.734 1.749
muDPGNANO140Xrun3 2500.2402 10.377 10.377 0.000 ( +0.0% ) 1.65 1.63 +1.5% 1.614 1.625
muDPGNANOBkg140Xrun3 2500.2403 6.401 6.401 0.000 ( +0.0% ) 16.22 15.23 +6.5% 1.167 1.156
hcalDPGNANO140Xrun3 2500.2404 486.015 486.015 0.000 ( +0.0% ) 1.15 1.16 -0.8% 1.586 1.579
hcalDPGCalibNANO140Xrun3 2500.2405 826.418 826.418 0.000 ( +0.0% ) 1.53 1.51 +1.3% 1.578 1.552
hcalDPGMCNANO140Xrun3 2500.2501 645.333 645.333 0.000 ( +0.0% ) 1.65 1.64 +0.6% 1.652 1.658
NANOmc2024reMINI 2500.2601 0.021 0.021 0.000 ( +0.2% ) 1.92 1.90 +1.3% 2.631 2.625
NANOdata2024reMINI 2500.2701 0.036 0.036 0.000 ( +0.0% ) 1.88 1.89 -0.7% 2.562 2.554
NANOmc150X 2500.3001 3.217 3.217 0.000 ( +0.0% ) 16.92 17.09 -1.0% 2.539 2.516
NANOdata150X 2500.3101 2.144 2.144 0.000 ( +0.0% ) 32.76 33.30 -1.6% 2.218 2.210
NANOdata150X 2500.3102 2.630 2.630 0.000 ( +0.0% ) 27.52 27.56 -0.2% 2.264 2.260
muPOGNANOmc150X 2500.3201 2.255 2.255 0.000 ( +0.0% ) 15.78 16.21 -2.7% 2.345 2.344
EGMNANOmc150X 2500.3202 4.110 4.110 0.000 ( +0.0% ) 14.01 14.22 -1.5% 2.456 2.467
BTVNANOmc150X 2500.3203 10.552 10.552 0.000 ( +0.0% ) 4.73 4.64 +2.0% 2.657 2.670
jmeNANOmc150X 2500.3204 6.452 6.452 0.000 ( +0.0% ) 1.15 1.30 -11.6% 2.631 2.626
jmeNANOrePuppimc150X 2500.3205 6.456 6.456 0.000 ( +0.0% ) 1.07 1.24 -13.7% 2.956 2.951
lepTrackInfoNANOmc150X 2500.3206 3.720 3.720 0.000 ( +0.0% ) 12.91 14.67 -12.0% 2.447 2.469
ScoutingNANOmc150X 2500.3207 1.563 1.563 0.000 ( +0.0% ) 17.38 19.26 -9.7% 2.245 2.248
ScoutingNANOwithPromptmc150X 2500.3208 4.774 4.774 0.000 ( +0.0% ) 10.61 10.38 +2.2% 2.754 2.721
BPHNANOmc150X 2500.3209 4.126 4.126 0.000 ( +0.0% ) 17.42 16.79 +3.8% 2.555 2.555
muPOGNANO150Xrun3 2500.3301 1.125 1.125 0.000 ( +0.0% ) 28.33 31.89 -11.2% 2.043 2.073
EGMNANOdata150Xrun3 2500.3302 2.985 2.985 0.000 ( +0.0% ) 23.26 25.99 -10.5% 2.138 2.135
BTVNANOdata150Xrun3 2500.3303 7.971 7.971 0.000 ( +0.0% ) 5.35 5.85 -8.4% 2.344 2.364
jmeNANOdata150Xrun3 2500.3304 4.349 4.349 0.000 ( +0.0% ) 1.38 1.62 -15.2% 2.462 2.307
jmeNANOrePuppidata150Xrun3 2500.3305 4.332 4.332 0.000 ( +0.0% ) 1.19 1.39 -14.0% 2.597 2.583
lepTrackInfoNANOdata150Xrun3 2500.3306 2.625 2.625 0.000 ( +0.0% ) 25.96 27.83 -6.7% 2.168 2.131
ScoutingNANOdata150Xrun3 2500.3307 1.738 1.738 0.000 ( +0.0% ) 25.67 31.21 -17.7% 1.474 1.469
ScoutingNANOmonitordata150Xrun3 2500.3308 1.400 1.400 0.000 ( +0.0% ) 20.87 27.05 -22.8% 2.135 2.100
ScoutingNANOmonitorWithPromptdata150Xrun3 2500.3309 2.602 2.602 0.000 ( +0.0% ) 14.87 17.69 -15.9% 2.509 2.482
BPHNANOdata150Xrun3 2500.331 2.632 2.632 0.000 ( +0.0% ) 25.77 32.09 -19.7% 2.247 2.247
TTbarMINIAOD10.6_UL18v2 2500.9001 1.819 1.819 0.000 ( +0.0% ) 22.75 35.25 -35.4% 1.752 1.766
TTbarMINIAOD14.0 2500.9002 1.665 1.665 0.000 ( +0.0% ) 23.36 33.57 -30.4% 1.410 1.373
DYToLL_M-50_13TeV_pythia8 2500.9101 15.163 15.163 0.000 ( +0.0% ) 5.99 6.98 -14.2% 1.035 1.027
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV 2500.9102 0.199 0.310 -0.111 ( -35.7% ) 2.46 2.67 -8.1% 0.823 0.841
TTbar_Pow_LHE_13TeV 2500.9103 0.110 0.110 0.000 ( +0.0% ) 1.65 2.51 -34.4% 0.832 0.842

NANO Comparison Summary

Summary:

  • You potentially removed 1567 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 32
  • DQMHistoTests: Total histograms compared: 43020
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 43020
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
  • Checked 181 log files, 106 edm output root files, 32 DQM output files
  • TriggerResults: no differences found

Comment on lines 35 to 45
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is my last comment. test_vector is called within the produce method. Throwing an exception if a value is not meaningful looks to me a quite drastic approach.
Isn't there any default value you could assign (i.e. if scores are >0 a negative number would be likely enough) instead of doing that?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rather than returning an invalid number, it would be better to have the function return a std::optional<>. That will properly express when something fails and avoids accidentally trying to use an invalid value.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Indeed you are right, std::optional<> is a better option.

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Apr 4, 2026

Milestone for this pull request has been moved to CMSSW_17_0_X. Please open a backport if it should also go in to CMSSW_16_1_X.

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Apr 7, 2026

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48502/48891

Code check has found code style and quality issues which could be resolved by applying following patch(s)

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Apr 7, 2026

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-48502/48892

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Apr 7, 2026

Pull request #48502 was updated. @AdrianoDee, @DickyChant, @antoniovagnerini, @battibass, @cmsbuild, @ftorrresd, @miquork can you please check and sign again.

@tvami
Copy link
Copy Markdown
Contributor

tvami commented Apr 7, 2026

@cmsbuild please test

@cmsbuild
Copy link
Copy Markdown
Contributor

cmsbuild commented Apr 7, 2026

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-f12b81/52516/summary.html
COMMIT: 450de32
CMSSW: CMSSW_17_0_X_2026-04-07-1100/el8_amd64_gcc13
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/48502/52516/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially added 16 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 2 differences found in the comparisons
  • DQMHistoTests: Total files compared: 53
  • DQMHistoTests: Total histograms compared: 4180749
  • DQMHistoTests: Total failures: 108
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 4180621
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 52 files compared)
  • Checked 227 log files, 197 edm output root files, 53 DQM output files
  • TriggerResults: no differences found

Nano size comparison Summary:

  • Nano ERROR: Missing ref/2500.321_EXONANOmc150X-size.json
  • Nano ERROR: Missing ref/2500.321_EXONANOmc150X-size.json
  • Nano ERROR: Missing ref/2500.3311_EXONANOdata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3311_EXONANOdata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3312_L1ScoutingNANOdata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3312_L1ScoutingNANOdata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3313_L1ScoutingSelectionNANOdata150Xrun3-size.json
  • Nano ERROR: Missing ref/2500.3313_L1ScoutingSelectionNANOdata150Xrun3-size.json
workflow id kb/ev ref kb/ev diff kb/ev ev/s/thd ref ev/s/thd diff rate mem/thd ref mem/thd
NANOmc106Xul16v2 2500.0001 3.094 3.094 0.000 ( +0.0% ) 3.51 3.77 -6.9% 2.660 2.675
NANOmc106Xul16APVv2 2500.0002 3.048 3.048 0.000 ( +0.0% ) 3.31 3.62 -8.6% 2.709 2.712
NANOmc106Xul17v2 2500.0003 3.153 3.153 0.000 ( +0.0% ) 3.25 3.52 -7.7% 3.117 3.130
NANOmc106Xul18v2 2500.0004 3.105 3.105 0.000 ( +0.0% ) 3.30 3.52 -6.3% 3.094 3.119
NANOdata106Xul16v2 2500.0101 1.540 1.540 0.000 ( +0.0% ) 5.87 6.30 -6.9% 2.739 2.769
NANOdata106Xul17v2 2500.0102 1.926 1.926 0.000 ( +0.0% ) 3.94 4.12 -4.5% 2.969 2.952
NANOdata106Xul18v2 2500.0103 1.890 1.890 0.000 ( +0.0% ) 4.79 5.04 -4.9% 2.849 2.838
NANOmcUL16APVreMINI 2500.0201 0.022 0.022 0.000 ( +0.0% ) 1.66 1.86 -10.8% 2.635 2.633
NANOmcUL16reMINI 2500.0202 0.022 0.022 0.000 ( +0.0% ) 1.61 1.80 -10.5% 2.654 2.644
NANOmcUL17reMINI 2500.0203 0.022 0.022 0.000 ( +0.0% ) 1.56 1.67 -6.8% 2.747 2.912
NANOmcUL18reMINI 2500.0204 0.022 0.022 0.000 ( +0.0% ) 1.39 1.61 -13.7% 2.822 2.795
NANOdataUL16APVreMINI 2500.0301 0.035 0.035 0.000 ( +0.0% ) 1.32 1.57 -15.6% 2.692 2.689
NANOdataUL16reMINI 2500.0302 0.036 0.036 0.000 ( +0.0% ) 1.41 1.56 -9.5% 2.610 2.622
NANOdataUL17reMINI 2500.0303 0.037 0.037 0.000 ( +0.1% ) 1.34 1.52 -12.3% 2.724 2.734
NANOdataUL18reMINI 2500.0304 0.036 0.036 0.000 ( +0.0% ) 1.35 1.54 -12.8% 2.717 2.700
NANOmcUL16APVMini2Mini 2500.0401 0.023 0.023 0.000 ( +0.0% ) 2.29 2.62 -12.7% 2.200 2.226
NANOmcUL16Mini2Mini 2500.0402 0.023 0.023 0.000 ( +0.0% ) 2.27 2.51 -9.3% 2.158 2.147
NANOmcUL17Mini2Mini 2500.0403 0.023 0.023 -0.000 ( -0.2% ) 2.10 2.32 -9.6% 2.148 2.173
NANOmcUL18Mini2Mini 2500.0404 0.023 0.023 0.000 ( +0.0% ) 2.12 2.42 -12.5% 2.172 2.173
NANOdataUL16Mini2Mini 2500.0501 0.039 0.039 -0.000 ( -0.1% ) 3.10 3.44 -10.0% 1.991 2.006
NANOdataUL17Mini2Mini 2500.0502 0.040 0.040 0.000 ( +0.0% ) 2.04 2.58 -21.0% 2.055 2.062
NANOdataUL18Mini2Mini 2500.0503 0.039 0.039 0.000 ( +0.0% ) 2.70 3.00 -9.8% 2.049 2.067
NANOmc130X 2500.1001 3.228 3.228 0.000 ( +0.0% ) 3.95 4.18 -5.7% 3.140 2.985
NANOdata130Xrun3 2500.1101 1.790 1.790 0.000 ( +0.0% ) 6.13 6.48 -5.3% 2.696 2.701
NANOmc23Mini2Mini 2500.1201 0.022 0.022 0.000 ( +0.0% ) 2.62 2.74 -4.3% 2.000 2.003
NANOdata23Mini2Mini 2500.1301 0.041 0.041 0.000 ( +0.1% ) 3.35 3.63 -7.7% 2.293 2.355
ScoutingNANOdata124Xrun3 2500.1501 0.772 0.772 0.000 ( +0.0% ) 32.84 34.48 -4.7% 1.464 1.494
ScoutingNANOmonitordata124Xrun3 2500.1502 0.862 0.862 0.000 ( +0.0% ) 13.84 14.18 -2.4% 1.412 1.448
ScoutingNANOdata130Xrun3 2500.1503 1.251 1.251 0.000 ( +0.0% ) 24.22 25.39 -4.6% 1.455 1.461
ScoutingNANOmonitordata130Xrun3 2500.1504 1.297 1.297 0.000 ( +0.0% ) 10.32 10.31 +0.1% 1.378 1.380
muPOGNANOmc140X 2500.2201 2.269 2.269 0.000 ( +0.0% ) 5.23 5.62 -7.0% 2.083 2.125
EGMNANOmc140X 2500.2202 3.859 3.859 0.000 ( +0.0% ) 3.78 4.05 -6.8% 2.405 2.432
BTVNANOmc140X 2500.2203 10.475 10.475 0.000 ( +0.0% ) 2.42 2.59 -6.6% 2.588 2.592
jmeNANOmc140X 2500.2204 6.639 6.639 0.000 ( +0.0% ) 1.08 1.17 -7.1% 2.492 2.556
lepTrackInfoNANOmc140X 2500.2206 3.553 3.553 0.000 ( +0.0% ) 3.79 4.05 -6.4% 2.409 2.406
ScoutingNANOmc140X 2500.2207 1.488 1.488 0.000 ( +0.0% ) 13.24 14.37 -7.8% 1.789 1.796
ScoutingNANOwithPromptmc140X 2500.2208 4.461 4.461 0.000 ( +0.0% ) 2.77 3.19 -13.4% 2.722 2.715
muPOGNANO140Xrun3 2500.2301 1.683 1.683 0.000 ( +0.0% ) 7.31 7.88 -7.3% 2.341 2.337
EGMNANOdata140Xrun3 2500.2302 2.623 2.623 0.000 ( +0.0% ) 5.52 5.86 -5.8% 2.666 2.674
BTVNANOdata140Xrun3 2500.2303 5.612 5.612 0.000 ( +0.0% ) 3.51 3.74 -6.1% 2.854 2.856
jmeNANOdata140Xrun3 2500.2304 3.976 3.976 0.000 ( +0.0% ) 1.41 1.49 -5.2% 2.722 2.750
lepTrackInfoNANOdata140Xrun3 2500.2306 2.413 2.413 0.000 ( +0.0% ) 5.53 5.86 -5.6% 2.668 2.682
ScoutingNANOdata140Xrun3 2500.2307 1.101 1.101 0.000 ( +0.0% ) 29.11 30.30 -3.9% 1.450 1.474
ScoutingNANOmonitordata140Xrun3 2500.2308 2.784 2.784 0.000 ( +0.0% ) 4.34 5.13 -15.4% 2.935 2.940
ScoutingNANOmonitorWithPromptdata140Xrun3 2500.2309 2.784 2.784 0.000 ( +0.0% ) 4.25 5.13 -17.1% 2.924 2.951
L1ScoutingSelectionNANOdata140Xrun3 2500.2311 0.081 0.081 0.000 ( +0.0% ) 48.12 49.12 -2.0% 0.684 0.844
L1ScoutingNANOdata140Xrun3 2500.231 0.082 0.082 0.000 ( +0.0% ) 4.00 4.10 -2.6% 0.830 0.830
l1DPGNANO140Xrun3 2500.2401 9.405 9.405 0.000 ( +0.0% ) 3.69 5.46 -32.5% 1.719 1.740
muDPGNANO140Xrun3 2500.2402 10.377 10.377 0.000 ( +0.0% ) 1.43 1.55 -7.5% 1.583 1.612
muDPGNANOBkg140Xrun3 2500.2403 6.401 6.401 0.000 ( +0.0% ) 14.09 15.15 -7.0% 1.189 1.187
hcalDPGNANO140Xrun3 2500.2404 486.015 486.015 0.000 ( +0.0% ) 1.12 1.17 -4.2% 1.597 1.578
hcalDPGCalibNANO140Xrun3 2500.2405 826.418 826.418 0.000 ( +0.0% ) 1.49 1.52 -1.8% 1.578 1.603
hcalDPGMCNANO140Xrun3 2500.2501 645.333 645.333 0.000 ( +0.0% ) 1.64 1.67 -2.0% 1.685 1.671
NANOmc2024reMINI 2500.2601 0.021 0.021 0.000 ( +0.0% ) 1.85 1.96 -5.5% 2.679 2.708
NANOdata2024reMINI 2500.2701 0.036 0.036 0.000 ( +0.0% ) 1.83 1.92 -4.7% 2.656 2.607
NANOmc150X 2500.3001 3.224 3.224 0.000 ( +0.0% ) 15.68 17.37 -9.7% 2.592 2.637
NANOdata150X 2500.3101 2.144 2.144 0.000 ( +0.0% ) 32.07 35.04 -8.5% 2.263 2.279
NANOdata150X 2500.3102 2.630 2.630 0.000 ( +0.0% ) 27.51 29.15 -5.6% 2.324 2.306
muPOGNANOmc150X 2500.3201 2.344 2.344 0.000 ( +0.0% ) 14.79 16.31 -9.3% 2.421 2.431
EGMNANOmc150X 2500.3202 4.118 4.118 0.000 ( +0.0% ) 13.49 14.78 -8.7% 2.543 2.539
BTVNANOmc150X 2500.3203 10.559 10.559 0.000 ( +0.0% ) 4.42 4.97 -11.2% 2.705 2.753
jmeNANOmc150X 2500.3204 6.460 6.460 0.000 ( +0.0% ) 0.93 1.38 -32.7% 2.675 2.743
jmeNANOrePuppimc150X 2500.3205 6.464 6.464 0.000 ( +0.0% ) 0.93 1.28 -27.2% 3.160 3.011
lepTrackInfoNANOmc150X 2500.3206 3.728 3.728 0.000 ( +0.0% ) 12.10 15.47 -21.8% 2.494 2.499
ScoutingNANOmc150X 2500.3207 1.563 1.563 0.000 ( +0.0% ) 14.25 19.74 -27.8% 2.236 2.300
ScoutingNANOwithPromptmc150X 2500.3208 4.781 4.781 0.000 ( +0.0% ) 9.68 10.55 -8.3% 2.755 2.702
BPHNANOmc150X 2500.3209 4.135 4.135 0.000 ( +0.0% ) 14.82 16.76 -11.6% 2.593 2.679
muPOGNANO150Xrun3 2500.3301 1.244 1.244 0.000 ( +0.0% ) 25.26 30.65 -17.6% 2.098 2.107
EGMNANOdata150Xrun3 2500.3302 2.985 2.985 0.000 ( +0.0% ) 20.74 27.09 -23.4% 2.223 2.185
BTVNANOdata150Xrun3 2500.3303 7.971 7.971 0.000 ( +0.0% ) 4.98 6.07 -17.9% 2.575 2.388
jmeNANOdata150Xrun3 2500.3304 4.349 4.349 0.000 ( +0.0% ) 1.14 1.68 -32.0% 2.493 2.424
jmeNANOrePuppidata150Xrun3 2500.3305 4.332 4.332 0.000 ( +0.0% ) 1.02 1.46 -29.8% 2.696 2.643
lepTrackInfoNANOdata150Xrun3 2500.3306 2.625 2.625 0.000 ( +0.0% ) 22.94 28.82 -20.4% 2.317 2.193
ScoutingNANOdata150Xrun3 2500.3307 1.738 1.738 0.000 ( +0.0% ) 21.07 32.31 -34.8% 1.476 1.473
ScoutingNANOmonitordata150Xrun3 2500.3308 1.400 1.400 0.000 ( +0.0% ) 16.53 27.35 -39.6% 2.099 2.122
ScoutingNANOmonitorWithPromptdata150Xrun3 2500.3309 2.602 2.602 0.000 ( +0.0% ) 12.19 17.99 -32.2% 2.469 2.473
BPHNANOdata150Xrun3 2500.331 2.632 2.632 0.000 ( +0.0% ) 19.60 33.87 -42.1% 2.290 2.318
L1ScoutingNANOdata160Xrun3 2500.4301 0.110 0.110 0.000 ( +0.0% ) 1.92 2.13 -10.2% 0.871 0.941
L1ScoutingSelectionNANOdata160Xrun3 2500.4302 0.113 0.113 0.000 ( +0.0% ) 13.83 19.31 -28.4% 0.861 0.966
TTbarMINIAOD10.6_UL18v2 2500.9001 1.814 1.814 0.000 ( +0.0% ) 28.98 36.43 -20.4% 1.798 1.911
TTbarMINIAOD14.0 2500.9002 1.662 1.662 0.000 ( +0.0% ) 27.85 35.27 -21.0% 1.421 1.494
DYToLL_M-50_13TeV_pythia8 2500.9101 14.992 14.992 0.000 ( +0.0% ) 4.86 5.31 -8.5% 1.104 1.113
DYToll01234Jets_5f_LO_MLM_Madgraph_LHE_13TeV 2500.9102 0.437 0.199 0.237 ( +118.9% ) 2.94 2.21 +33.3% 0.886 0.894
TTbar_Pow_LHE_13TeV 2500.9103 0.110 0.110 0.000 ( +0.0% ) 2.22 2.41 -7.7% 0.866 0.896

NANO Comparison Summary

Summary:

  • You potentially removed 168 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 32
  • DQMHistoTests: Total histograms compared: 43020
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 43020
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
  • Checked 185 log files, 108 edm output root files, 32 DQM output files
  • TriggerResults: no differences found

@battibass
Copy link
Copy Markdown

+xpog

@battibass
Copy link
Copy Markdown

As agreed during the xPOG meeting, this is a first step in integrating the EXOnano flavour in CMSSW.

Investigations into possible optimisation of the event size and into changes that allow the production of EXOnano from MiniAOD (currently works with AOD) are expected as a later step.

In addition, matters regarding the large-scale central production of EXOnano will also have to be agreed upon with PPD.

@Ang-Li-95
Copy link
Copy Markdown
Contributor

As agreed during the xPOG meeting, this is a first step in integrating the EXOnano flavour in CMSSW.

Investigations into possible optimisation of the event size and into changes that allow the production of EXOnano from MiniAOD (currently works with AOD) are expected as a later step.

In addition, matters regarding the large-scale central production of EXOnano will also have to be agreed upon with PPD.

Thanks a lot! We agree that we will investigate possibilities of the production of EXOnano from MiniAOD for future EXOnano versions (this will likely to based on a extended MiniAOD in the future as we discussed during the xPOG meetings). For our current setting, we are wondering whether there are additional actions we should take to have this PR merged?

@battibass
Copy link
Copy Markdown

As agreed during the xPOG meeting, this is a first step in integrating the EXOnano flavour in CMSSW.
Investigations into possible optimisation of the event size and into changes that allow the production of EXOnano from MiniAOD (currently works with AOD) are expected as a later step.
In addition, matters regarding the large-scale central production of EXOnano will also have to be agreed upon with PPD.

Thanks a lot! We agree that we will investigate possibilities of the production of EXOnano from MiniAOD for future EXOnano versions (this will likely to based on a extended MiniAOD in the future as we discussed during the xPOG meetings). For our current setting, we are wondering whether there are additional actions we should take to have this PR merged?

From xpog we don't have any other request before merging.
@cms-sw/pdmv-l2 do you have any further feedback?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.